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© When a plurality of processors share a plurality 
of tasks and parallelly process the shared tasks, 
each of these processors outputs bit information for 
designating a processor in a group to which the 
processor belongs, when a currently executed task 
processing has been terminated, and the bit informa- 
tion is stored in a synchronous register (UB0 - UBn; 
5) disposed in each of the processors. When it is 
detected that all of processors in the same group 
have terminated task processings, each of these 
processors in the same group are supplied with a 
synchronization termination signal from the synchro- 
nous registers related thereto. Before all of the task 
processings have been terminated in the same 
group, any processors in the same group which 
have already terminated their task processings 
progress the execution of the next tasks until they 
access for the first time a data sharing circuit (102) 
for holding data shared among the processors. 
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BACKGROUND OF THE INVENTION 

This invention relates to a multi-processor sys- 
tem, and more particularly, to a synchronous ap- 
paratus for processors suitable for use in establish- 
ing synchronization of processors with one another. 

A conventional synchronous processing In a 
multi-processor system basically refers to synchro- 
nization among tasks (putting in order processing 
of the tasks), wherein the tasks are started and 
processed in a task driven or data driven manner. 
Implementation of such a configuration on a 
general-purpose multi-processor system employs a 
method of providing a task termination flag on a 
shared memory with which each of tasks examines 
whether or not a necessary preceding task pro- 
cessing has been completed and progresses a task 
processing in data flow manner, and a token con- 
trol method. Such a conventional synchronous pro- 
cessing is described in "Multi-microprocessor Sys- 
tem", Keigaku Shuppan, November, 1984, pp. 117 
to 119. Also, a conventional multi-processor system 
is disclosed in U.S.P. 4,493,053. 

The above-mentioned prior art related to a 
general-purpose multi-processor system, since a 
processing is mainly executed by software and 
many check items are included, implies large syn- 
chronous processing overhead caused by synchro- 
nization among tasks (keeping the processing order 
of tasks correctly without contradiction) or synchro- 
nization among processors. Therefore, the tasks 
cannot be sufficiently fractionized (fine task di- 
vision). The prior art also implies a problem in that 
the task processing order for a parallel processing 
is excessively restricted because the hardware for 
communications among processors is restricted in 
general, whereby advantages of the parallel pro- 
cessing cannot be sufficiently obtained, so that it is 
difficult to achieve a highly efficient parallel pro- 
cessing. 

Further, in a conventional multi-processor sys- 
tem which is provided with a limited number of 
processors for processing multiple tasks, when one 
of the processors has completed a task processing 
and is going to progress the next task processing, 
a synchronous processing is required for confirm- 
ing that other necessary task processings have 
been completed and necessary results have been 
provided. In this event, the one processor is oc- 
cupied by the synchronization check processing 
with software method, so that an empty processing 
time is produced where the one processor is sub- 
stantially prevented from executing effective pro- 
cessing until the synchronization check processing 
has been completed. 

SUMMARY OF THE INVENTION 



It is an object of the invention to provide a 
synchronous method and apparatus for processors 
which is capable of reducing an empty processing 
time, produced in a queuing processing among 

5 processors during a synchronous processing, 
which is inherent to a parallel processing executed 
by a general-purpose multi-processor system. 

To achieve the above object, preferably, a syn- 
chronous register having the same number of bits 

w as a limited number of processors is associated 
with each of the processors for highly efficiently 
executing a parallel processing without contradic- 
tion while establishing synchronization of the pro- 
cessors with one another. A processor, when hav- 

15 ing terminated a task, stores in the synchronous 
registers of processors related to the processor, as 
task termination information, a bit sequence (data 
word) having bits corresponding to respective pro- 
cessors executing a plurality of tasks related to the 

20 task set to an active state. As the result, a task 
termination processing is executed for making a 
task termination line active by hardware. This op- 
eration is performed independently by all of the 
processors which are executing related tasks. A 

25 determination means monitors each synchronous 
register related to each processor and determines 
whether or not all of processors corresponding to 
respective set bits of each synchronous register 
have terminated respective task termination pro- 

30 cessings by comparing the bits with task termina- 
tion lines corresponding to the respective proces- 
sors. If the determination results shows that all of 
the related bits are true (tasks have been ter- 
miated) in each of the synchronous registers, it is 

35 regarded that synchronization has been established 
among the processors, and accordingly synchro- 
nization termination information is issued. A syn- 
chronous processing circuit (which is a hardware 
version of a synchronous processing for a limited 

40 number of processors without damaging the 
general-purpose features) is thus provided. 

Also preferably, a data sharing circuit and a 
local synchronization circuit, as will be explained 
hereinbelow, are provided in addition to the above- 

45 mentioned synchronous processing circuit in order 
to automatically reduce an empty processing time 
(inoperative processing time) of processors pro- 
duced during a synchronous processing period for 
a parallel processing without causing overhead. 

50 The data sharing circuit holds or provides nec- 

essary common data which should be shared by 
the processors for executing task processings and 
is accessible from each of the processors. 

The local synchronization circuit uncondition- 

55 ally proceeds a processor which has outputted the 
task termination information to the synchronous 
processing circuit and terminated a task to the next 
task. When the processor is to first obtain neces- 
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sary shared data from the data sharing circuit, if 
the synchronization termination information has not 
been issued from the synchronous processing cir- 
cuit, the local synchronization circuit prohibits the 
processor from accessing to the data sharing cir- 
cuit and keeps the processor waiting. 

When a task processing has been terminated 
but a synchronous processing is still being ex- 
ecuted, the processor can progress the next task 
processing as much as possible until shared data 
is needed in the next task, so that an empty 
processing time can be reduced, which is different 
from the prior art where the processor is uncondi- 
tionally kept waiting to cause an empty processing 
time. 

Further, if setting of values to the synchronous 
register only is performed by software provided for 
each processor and other synchronous processing 
is executed by hardware, it is possible to prog- 
ramably establish synchronization among proces- 
sors with minimum software overhead of approxi- 
mately one machine instruction. 

The above-mentioned means for reducing an 
empty processing time produced during a synchro- 
nous processing is also effective in reducing the 
critical path of the parallel processing itself, thereby 
making it possible to automatically execute a highly 
efficient parallel processing. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a hardware block diagram illustrating 
the whole arrangement of an embodiment ac- 
cording to the invention; 

FIG. 2 is a schematic circuit diagram illustrating 
the configuration of a signal control circuit 
shown in FIG. 1; 

FIG. 3 is a schematic circuit diagram illustrating 
an embodiment of a synchronous processing 
circuit shown in FIG. 1; 

FIG. 4 is a schematic circuit diagram illustrating 
another embodiment of the synchronous pro- 
cessing circuit shown in FIG. 1; 
FIG. 5 is an explanatory diagram illustrating an 
example of a control for a parallel processing 
executed by the synchronous apparatus for pro- 
cessors according to the invention; 
FIG. 6 is an explanatory diagram illustrating how 
a processing time is reduced by employing a 
local synchronization circuit in combination; 
FIG. 7 is a schematic ircuit diagram illustrating 
another embodiment of a synchronous process- 
ing circuit of the invention; 
FIG. 8 is a table showing an example of instruc- 
tion sets for a synchronous processing system 
for processors; and 

FIGS. 9A and 9B are explanatory diagrams illus- 
trating how a processing time reduction effect is 



produced by using a control flow. 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

5 

The whole arrangement of an embodiment of 
the present invention will hereinbelow be described 
with reference to FIGS. 1 - 3. 

A synchronous apparatus of the present inven- 

w tion comprises a synchronous processing circuit 
101 for performing a synchronous processing 
among processors necessary for a parallel pro- 
cessing, a plurality of processing units 100n (n = 
0, 1, 2, ...) for executing shared tasks assigned 

75 thereto, and a data sharing circuit CSYS 102 on a 
system bus 120 for providing and holding neces- 
sary common data required to communicate nec- 
essary data among processors 1n (n = 0, 1, 2, ...) 
disposed in the respective processing units 100n or 

20 local data sharing circuits CSYS 51 n (n = 0, 1 , 2, 
...) disposed in the respective processing units 
100n for maintaining the coherency of data. 

The synchronous processing circuit 101 re- 
ceives synchronization requests Sin (n = 0, 1, 2, 

25 ...) from the processors 1n in the processing units 
at corresponding input terminals SYNCnREQ, re- 
gards that all the processors are synchronized with 
one another when all of predetermined synchro- 
nization requests Sin become active, and sets 

30 synchronization check signals TESTn to the active 
state for announcing the completion of synchro- 
nization to concerned processors. The active syn- 
chronization check signals TESTn are supplied 
through respective TEST signal lines Tin to re- 

35 spective TEST input terminals of signal control 
circuits 50n disposed in the processing units 100n 
and those of the processors 1n. 

Each of the processors 1n examines the state 
of the TEST input terminal by hardware or software 

40 and determines whether or not synchronization has 
been established among processors which are to 
execute related processings. A basic function of 
the synchronous processing circuit 101 is com- 
posed of once returning the TESTn output to an 

45 inactive state when the synchronous processing 
circuit 101 receives the synchronization request 
Sin from the processor 1n and again setting the 
TESTn output to the active state when ail of the 
synchronization requests Sin from processors 

so which are to be synchronized with one another 
become active. 

A specific embodiment of the synchronous pro- 
cessing circuit 101 will be later explained in more 
detail with reference to FIGS. 3 and 4. In the 

55 present embodiment, the above-mentioned TESTn 
output operation is carried out by a single flip-flop 
7 for each of the processors 1n. Each of the 
processors 1n (n = 0, 1, 2, ...) supplies an active 
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synchronization request Sin as task termination 
information when a task processing has been ter- 
minated. The processor which has outputted the 
active synchronization request Sin should remain 
fundamentally in a waiting state until the related 
TESTn output becomes active because necessary 
data used for the next task processing has not 
been completely provided on the data sharing cir- 
cuits 102 and 51n(n = 0,1,2, ...). However, if the 
following conditions are satisfied, the respective 
processors can parallelly perform processings at 
the next level to some extent without contradiction 
in synchronism with one another. 

1) At a timing after the task termination informa- 
tion signals (the synchronization request Sin or 
information supplied to an SYNCnREQ terminal 
of the synchronous processing circuit) from the 
processors executing related task processings 
have all been set to the active state (all the 
necessary task processings have been termi- 
nated at a given level), active synchronization 
termination information (information delivered 
from the TESTn terminal and transmitted to the 
processing unit through the TEST signal line 
Tin) is supplied to each of processing units and 
processors which have issued the task termina- 
tion information. It is supposed that all informa- 
tion on the results of the task processing ex- 
ecuted at the level has not been provided until 
the synchronization termination information be- 
comes active. 

2) At the time when a processor has processed 
to a task processing at the next level (a task 
processing which should be executed at the 
next level) and accesses for first time the data 
sharing circuit 102 or 51 n holding data, included 
in the results of the task processing executed by 
other processors which should be commonly 
used by the processors, the processor must 
have confirmed that the synchronization termina- 
tion information had already become active. If 
the synchronization termination information is 
still in the inactive state at the time the data 
sharing circuit is to be accessed for first time in 
a task processing, the access to the data shar- 
ing circuit must be prohibited until the synchro- 
nization termination information becomes active. 

3) Assume now that a border between levels 
(task processing levels) is defined to be the time 
at which each of the processors issues the ac- 
tive task termination information. Stated another 
way, the end of each processing defined as a 
task is referred to as the level border. Assume 
also that the time at which an active synchro- 
nization termination information is issued from 
the synchronous processing circuit 101 is de- 
fined to be the border of the synchronization 
level. 



By executing a parallel processing in the most 
efficient manner, in addition to satisfying the above 
conditions, it is possible to reduce to a minimum 
an empty processing time (idle time produced by 

5 the fact that a processor which has reached a 
synchronization point at an earlier time is kept 
waiting until a synchronous processing is com- 
pleted) produced during a synchronous processing. 
In other words, a system is employed where the 

10 respective processors are adapted to progress, as 
soon as possible, processings which are to be 
executed at the next level. Specifically, in a task 
processing the synchronization termination informa- 
tion is plisregarded to thereby progress the task 

75 processing until the data sharing circuit is acces- 
sed for the first time, and then it is first confirmed 
whether or not the synchronization termination in- 
formation is in the active state (other processors 
have terminated necessary task processings, and 

20 all necessary common data exists in the data shar- 
ing circuit) at the time of the first access to the 
data sharing circuit. In other words, each processor 
forwardly progresses its processing as far as possi- 
ble by delaying a synchronization point thereof as 

25 much as possible. 

The above-mentioned system can produce ef- 
fects of dynamically changing a processing time 
required for executing each of tasks, which seem 
to be uniformly divided and generated, in accor- 

30 dance with the synchronization conditions, reducing 
the critical path of a parallel processing, and auto- 
matically achieving a highly efficient parallel pro- 
cessing nearly same as a data flow processing 
(data driven parallel processing). This system, dif- 

35 ferent from conventional one which depends only 
on information on synchronous processing termina- 
tion, executes a synchronous processing closely in 
association with an access processing for the data 
sharing circuit 102 or 51 n. The hardware of this 

40 system will be next explained, taking as examples 
the processing unit 100n shown in FIG. 1 and the 
signal control circuit 50n in the processing unit 
shown in detail in FIG. 2. 

The signal control circuit 51 n in each of the 

45 processing units 100n receives a control signal I9n 
including an address signal from the processor 1n, 
decodes the same to generate an access request 
signal I3n for accessing the sharing system CSYS 
51 n and the data sharing circuit bus 112, and 

50 supplies the access request signal 13n to an ar- 
bitration circuit DC103 for determining which of the 
processors is given an access right for accessing 
the data sharing circuit and the data sharing circuit 
bus 120. The arbitration circuit DC103, upon re- 

55 ceiving a plurality of the access request signals 
I3n (n = 1,2, ...) delivered from a plurality of the 
processing units, selects one from among the pro- 
cessing units, and sets an access permission sig- 
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nal I4n (n = 0, 1, 2, ...) corresponding to the 
selected processing unit to the active state. The 
signal control circuit 50n, when the access permis- 
sion signal £4n becomes active, turns on an output 
buffer 52n and outputs an address signal, a control 
signal, and an information signal, for a write opera- 
tion, through a bus line 15n to the data sharing 
circuit bus 120. On the other hand, for a read 
operation, data on the data sharing circuit bus 112 
is written into the local data sharing circuit CSYS 
51 n through the bus line X5n and an input buffer 
53n, or the processor 1n directly reads such data 
through a bus line 11 On. When the processor 1n 
reads information stored in the local data sharing 
circuit CSYS 51 n, a bus line Jt7n is interposed 
therebetween. The respective local data sharing 
circuits CSYS 51 n (n = 0, 1, 2, ...) in the process- 
ing units 100n must usually have the same con- 
tents as one another. Therefore, each processor 
1n, for a read operation, can access the local data 
sharing circuit CSYS 51 n just as a local memory 
independently of the other processors, whereas, a 
write operation must be executed by arbitrating the 
data sharing circuit bus 120 under the management 
of the arbitration circuit 103 because identical data 
should be written into the local data sharing circuits 
CSYS 51 n (n = 0, 1, 2, ...) in all the processing 
units 100n (n = 0, 1, 2, ...) through the data 
sharing circuit bus 120. In this event, an access 
contention may occur with an independently ex- 
ecuted read operation from the local data sharing 
circuit CSYS 51 n. Such a contention is also con- 
trolled by the signal control circuit 50n so as to 
allow an access to the local data sharing circuits 
without problem. 

FIG. 2 illustrates an embodiment of the signal 
control circuit or local synchronization circuit 50n. A 
decoder 200 decodes the control signal including 
an address signal 19n supplied from the processor 
1 n, and generates a control signal, an enable signal 
and so on required for an access request gen- 
erated by the processor 1n to access the data 
sharing circuits CSYS 51 n and 102. A data sharing 
circuit bus access request signal CSREQ (active at 
"LOW" level) 13n supplied to the arbitration circuit 
103 is generated by performing a logical OR op- 
eration of a data sharing circuit enable signal 
(active at "LOW" level) 2213 from the de- 
coder 200 and a synchronization termination in- 
formation signal SYNCOK (active at "LOW" level) 
Tin from the synchronous processing circuit 101. 
An acknowledge signal i4n from the arbitration 
circuit 103 is composed of a CSACK signal (an 
access request is accepted when this signal is at 
"LOW" level) 209 which is a direct response from 
the arbitration circuit 103 which has received the 
CSREQ signal 13n and a CSBUS signal (active at 
"LOW" level) indicating that the sharing system 



CSYS 51 n (n = 0, 1, 2, ...) is arbitrated by any one 
of the processing units. An RDYACK signal (active 
at "HIGH" level) 206 is controlled to be inactive or 
at "LOW" level when the CSBUSY signal 210 is 

5 active, thereby preventing an access contention 
with a write operation executed by one of the other 
processing units to the data sharing circuit CSYS 
51 n thereof when the processor 1n is to read data 
from the same. More specifically, when a write 

70 operation is being performed for the data sharing 
circuit CSYS 51 n, a NAND gate 208 becomes 
inactive (at "HIGH" level), and a read enable signal 
CSRD (active at "LOW" level) is set to be inactive. 
For example, suppose that the decoder 200 makes 

75 the CSEN signal 213 active for accessing the data 
sharing circuit 102. If an SYNCOKT signal In is 
inactive at this time, the CSREQ signal 13n will not 
become active by the action of an OR gate 212 as 
long as the SYNCOKT signal In remains inactive, 

20 whereby the CSACK signal 209 also remains inac- 
tive. A NOR gate 202 receiving the CSACK signal 
209 and the CSREQ signal I3n is thereby main- 
tained at "LOW" level. The decoder 200 holds the 
CSEN signal 213 at "LOW" level. The decoder 200 

25 holds the C5EN signal 213 at "LOW" level until the 
output from the NOR gate 202 becomes "HIGH" 
level. Similarly, a BFON signal I2n for controlling 
the output from the output buffer 52n, which also 
receives the output from the NOR gate 202, re- 

30 mains inactive (at "HIGH" level), whereby an ac- 
cess to the data sharing circuit bus 120 is kept 
waiting until the SYNCOKT signal In becomes 
active. A function for temporally automatical stop- 
ping an access of the processor 1n to CSYS 102 or 

35 51 n by hardware is achieved by maintaining inac- 
tive a READY signal (active at "LOW" level) I1n 
inputted to a READY terminal of the processor 1n 
to thereby prevent a bus cycle of the processor 1n 
from being terminated. 

40 The READY signal i 1 n becomes active by the 

action of an AND gate 211 when either of the 
CSRD signal Jt8n or the BFON signal I2n be- 
comes active, whereby the processor proceeds to 
the next operation. This operation is referred to as 

45 a local synchronization function. Similarly, the 
CSRD signal t8n is provided for accessing the 
supply system CSYS 51 n. The SYNCOK signal 
Tin is inverted by an invertor 207 so as to be 
active at "HIGH" level and then inputted to the 

50 NAND gate 208. Therefore, as long as the SYN- 
UUK signal Ttn remains in the inactive state, an 
access to the data sharing circuit CSYS 51 n is 
temporally stopped by making the CSRD signal 
I8n and the READY signal tin inactive. 

55 FIG. 3 illustrates a circuit portion 101 A con- 

stituting a processor 1 0 in the synchronization pro- 
cessing circuit 101. Each of NAND gates UAo - 
UAn ... receives a Q output of corresponding one of 
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flip-flops UCo - UCn ... and a Q output of cor- 
responding one of flip-flops UBo - UBn. When the 
outputs of all of the NAND gates UAo - UAn be- 
come "HIGH" level, a multiple input NAND gate 
UDo receiving these outputs delivers an output at 
"LOW" level. When the Q outputs of the respective 
flip-flops UCo - UCn ... are at "HIGH" level, the Q 
outputs of the flip-flops UBo - UBn ... inputted to 
the corresponding NAND gates UCo - UCn ... be- 
come valid or are inverted and appear at output 
terminals of the UCo - UCn • • • . In this embodi- 
ment, the determination as to whether the Q out- 
puts of the flip-flops are valid or invalid is made by 
the processor 1 0 . More specifically, when synchro- 
nization requests Sin (n = 0, 1, 2, ...) from cor- 
responding processors 1n (n = 0, 1, 2, ...) to the 
flip-flops UCo - UCn ... are to be disregarded, the 
processor 1 0 sets corresponding Si Do - SlDn (n 
= 0, 1, 2, ...) to "LOW" level (0). The processor 1 0 , 
after the termination of a task, generates a trigger 
signal to the synchronization request Sl 0 to set the 
Q output of the corresponding one of the flip-flops 
UCo - UCn ... to "LOW" level (0). Each of the 
processors 1n (n = 0, 1, 2, ...) generates a trigger 
signal to the corresponding one of synchronization 
request Slo - Sin ... to set the corresponding Q 
output to "LOW" level and the Q output to "HIGH" 
level to once make the synchronization termination 
information Tlo - Tin ... inactive. The outputs of 
the NAND gates UAo - UAn ... corresponding to the 
flip-flops UCo ■ UCn ... having the Q outputs set at 
"HIGH" level (1) go to "HIGH" level for the first 
time at that time. The output of the multiple input 
NAND gates UDo does not change from "HIGH" 
level to "LOW" level until all of the Q outputs of 
the flip-flops UBo - UBn ... corresponding to the 
flip-flops UCo - UCn ... having the Q outputs set at 
"HIGH" level are set to "LOW" level. By the output 
being at "LOW" level of the multiple input NAND 
gates UCfe, the flip-flops UB 0 - UBn ... are preset 
and the Q outputs thereof return to "HIGH" level. 
On the other hand, the Q outputs of the flip-flops 
UBo - UBn ... return to "LOW" level, and then the 
active synchronization termination information Tlo ■ 
Tin are supplied to the corresponding processors 
1n(n = 0,1,2,...). 

If all of the processors are to participate in a 
synchronous processing, all of the Q outputs of the 
flip-flops UCo - UCn ... may be set to "HIGH" level. 
This is referred to as a simultaneous sychronization 
mode. If the simultaneous synchronization mode is 
solely employed, the flip-flops UCo - UCn ... are 
not necessary. Alternatively, the Q outputs of the 
flip-flops UBo - UBn ... may be logically inverted by 
invertors and inputted directly to the mutiple input 
NAND gate UDo. 

Next, another embodiment of the synchronous 
processing circuit of the invention will be explained 



with reference to FIG. 4. A multi-processor system 
employed in this embodiment is supposed to com- 
prise m processors. In FIG. 4, a processor 1n and 
another processor 1n + 1 are representatively illus- 
5 trated. Each of the processors is provided with 
circuit units 2n, 2n + 1 for a synchronous process- 
ing among the processors. The units 2n, 2n + 1 are 
equivalent to a circuit portion indicated by 101 A in 
the synchronous processing circuit shown in FIG. 

10 3. The synchronous circuit units 2n, 2n + 1 commu- 
nicate information with each other through signal 
lines 8. According to this embodiment, processors 
executing related tasks arbitrarily form a group and 
can progress processings in synchronism with one 

15 another in the group. The above-mentioned circuit 
units 2n, 2n + 1 for establishing synchronization 
among processors, corresponding to the respective 
processors, are respectively composed of a syn- 
chronous register 5 for storing information related 

20 to a group name, a signal line for transmitting the 
states of flip-flops which are set at a timing of 
setting a value to the synchronous register 5 or at 
a later timing, a determination circuit 6 for compar- 
ing transmitted information with the contents of the 

25 synchronous register 5 and examining whether or 
not values registered in the synchronous register 5 
indicating that the states of processors belonging 
to a group are all true, and a signal circuit for 
announcing the examination result to the proces- 

30 sors. Reference numeral 4 designates an access 
signal, 8 a task termination signal line, 9 a status 
line, and 10 a trigger signal line. The synchronous 
register 5 corresponds to the flip-flops UCo - UCn 
... in the circuit 101 A shown in FIG. 3. In the 

35 present embodiment, the synchronous register 5 is 
provided for each of the corresponding processors, 
which can thereby independently select processors 
which are objects for a synchronous processing (in 
the example shown in FIG. 3, the processor 1o only 

40 is authorized to have the selection right.) The 
present embodiment employs a configuration of 
distributively providing synchronous processing cir- 
cuit units for the respective processors, wherein the 
distributed synchronous processing circuit units 2n 

45 (n = 0, 1, 2, ... m) communicate necessary data 
through the signal lines 8. It is therefore appre- 
ciated that a circuit portion including the synchro- 
nous processing circuit units 2n (n = 0, 1, 2, ... m) 
and the signal lines 8 constitutes the synchronous 

so processing circuit 101 shown in FIG. 1. 

Next, a synchronization operation sequence in 
a processor group will be described. Suppose that 
processors 1n and 1n + 1, for example, in the pro- 
cessors 1o - 1m form a group and are executing 

55 related tasks. 

First, the operation of the processor 1n will be 
mainly explained. The processor 1n, when having 
terminated a task processing, stores in the syn- 
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chronous register 5, through a data line 3 (Si Do - 
SIDn - SI Dm), a bit sequence (for indicating a 
processor group) having the nth and (n#1)th bits 
set to logical "1" and the remaining bits set to 
logical "0". In a write operation, a signal line 4 for 
indicating that the processor 1n is accessing the 
synchronous register 5 generates an active pulse 
which serves as a clock signal for writing into the 
synchronous register 5. 

Simultaneously, a flip-flop 7 is also triggered 
by the active pulse on the signal line 4, whereby a 
task termination signal at logical "0" is delivered at 
its output terminal Q while a status signal at logical 
"1" at its output terminal G. The task termination 
signal from the output terminal Q is coupled to the 
nth line of the signal lines 8 through which it is 
transmitted to the synchronous processing circuit 
units 2o -2m of the respective processors. On the 
other hand, the status signal from the output termi- 
nal Q is supplied to a TEST input terminal of the 
processor 1 n through the status line 9. The proces- 
sor 1n interrupts its processing until the status 
signal at the TEST input terminal becomes "0" 
level. Values stored in the synchronous register 5 
and those on the signal lines 8, which maintain a 
correlation with each other from 0 to m, are sup- 
plied to the determination circuit 6. In this embodi- 
ment, when all values of the task termination signal 
lines 8 corresponding to bits of the synchronous 
register 5 set to logical "1" become logical "0" by 
the action of a NAND-NAND gate (corresponding to 
the NAND gates UAo - UAn ... and the multiple 
input NAND gate UDo in the synchronous process- 
ing circuit 101 A), or when the nth and (n#1)th lines 
of the task signal termination signal lines 8 become 
logical "0", a trigger signal 10 becomes active or 
logical "0". The flip-flop 7, in response to the 
active trigger signal 10, is preset, whereby the task 
termination signal 1 from the terminal Q and ac- 
cordingly the nth line of the task termination signal 
lines 8 become logical "1", causing the trigger 
signal 10 to become logical "1". Simultaneously, 
the status signal at the terminal Q becomes logical 
"0", causing the TEST input terminal of the proces- 
sor 1n to also become logical "0 n , whereby the 
processor 1n resumes so far interrupted process- 
ing. The same operation is performed also in the 
processor n + 1, so that the processors 1n and 
1 n + 1 are synchronized with each other, as the 
result, at the time both of them have terminated 
task processings thereof. As described above, the 
flip-flop 7 disposed in each of synchronous pro- 
cessing circuit units, in spite of its simple structure, 
can control all of the task termination output, status 
output and processing resumption output. 

The above-mentioned is the operation se- 
quence performed by the synchronous processing 
circuit of the invention. In this invention, the syn- 



chronous processing performed by software is only 
a writing of values into the synchronous register 5 
which merely requires a processing time of ap- 
proximately one machine instruction on the ma- 
5 chine language basis. The rest of processing is all 
performed by hardware, so that overhead required 
for the synchronous processing is minimized under 
the condition that such processing is program- 
mable. 

w Further according to the invention, it is possible 

to group related processors only by utilizing a set 
of the synchronous processing circuit 101, which 
facilitates the synchronous processing for proces- 
sors belonging to respective groups. Also, the pro- 

75 vision of plural sets of the synchronous processing 
circuits 101 allows multipelxed synchronous pro- 
cessing among the groups. The division of the 
processors into groups and the multiple synchro- 
nization provide flexibility in the parallel processing, 

20 thereby making it possible to achieve a highly 
efficient parallel processing close to a data flow on 
a general-purpose multi-processor system. 

FIG. 5 illustrates the flow of a parallel process- 
ing controlled by the synchronous processing cir- 

25 cuit 101. The example shown in FIG. 5 does not 
employ the local synchronous processing per- 
formed in the signal control circuit 50n, so that the 
sycnhronous processing is supposed to be ex- 
ecuted by checking the synchronization termination 

30 information generated from the synchronous pro- 
cessing circuit 101 by the processor 1n. It is also 
supposed in FIG. 5 that a parallel processing per- 
formed by four processors a - d is controlled by 
the synchronous processing circuit 101 of the in- 

35 vention from the upper part to the lower part of the 
drawing with the lapse of time. First, tasks ® and 
® , which are related to each other, are being 
processed by the processors a and b, respectively, 
while tasks Q) and @ are likewise being pro- 

40 cessed by the processors c and d. Since proces- 
sors executing related tasks can be collected as a 
group, the processors a and b forms a group 1 1 , 
and the processors c and d a group 12. Each of 
solid arrows connecting between respective two 

45 tasks indicates a flow of processing and data in a 
single processor. One-dot chain arrows each in- 
dicates a flow of data between tasks respectively 
executed by one and the other processors in a 
group, that is, communications between processors 

so in a group. At each of times ti and k , communica- 
tions are needed in each of the two groups, a 
synchronous processing is executed by the syn- 
chronous processing circuit 101, and then pro- 
cessed data is exchanged between the processors 

55 in each of the groups. Thereafter, the group formed 
of the processors a and b proceeds to the process- 
ing of tasks © and © , while the groups formed 
of the processors c and d proceeds to the process- 
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ing of tasks © and (§) . Thus, the synchronous 
processing performed by the synchronous process- 
ing circuit 101 for processors shown in FIG. 4 
indicates with which processors each of groups 
was formed and how the task processing so far has 
been executed. The grouping of the processors 
does not give rise to data communications between 
different groups, so that each group can progress 
its processing independently of one another. Since 
the progress of the parallel processing is flexibly 
controlled, an efficient parallel processing can be 
achieved. Thereafter, groups 13 and 14 are formed 
of the same processors as those forming the 
groups 11 and 12, respectively, for executing other 
task processings. At times, U and U, a synchro- 
nous processing is performed for communicating 
data between processors in each group. At a time 
ts, all of tasks ® - @ are related to one another 
and therefore independence between the groups 
disappears, so that after a synchronous processing 
has been performed in each of the groups, another 
synchronous processing is again performed by the 
synchronous processing circuit 101 for processors 
in the different group to synchronize all of the 
processors. In other words, it can be thought that 
the synchronous processing has been performed 
by the synchronous processing circuit 101 for pro- 
cessors in the different group for synchronizing the 
two groups, which consequently results in forming 
a group 15 including all of the processors. After- 
ward, the processors a - c which are to process 
related tasks @ - © form a group 16, while the 
processor d which is to process an independent 
task © separately forms a group 17. In this man- 
ner, the processors a - d, re-forming groups, ex- 
ecute the parallel processing while performing the 
synchronous processing at each of times t6 and tz. 
By thus performing multiplexed synchronous pro- 
cessing by plural sets of the synchronous process- 
ing circuits 101, re-formation of groups can be 
readily carried out, which results in achieving a 
more flexible and highly efficient parallel process- 
ing. 

FIGS. 6 depicts specific effects produced by 
the synchronous processing apparatus for proces- 
sors shown in FIG. 1 formed with the synchronous 
processing circuits of the invention shown in FIG. 
4. In the drawing of Fig. 6, an analysis is carried 
out by breaking up a parallel processing into 
instructions of the processor which are minimum 
units constituting a task. FIG. 6(a) illustrates a case 
where a parallel processing is performed among 
processors only depending on the synchronization 
termination information Tin without employing the 
local synchronization method. In other words, it can 
be thought that a part of the parallel processing 
flow shown in FIG. 5 is cut out. Operating con- 
ditions and assumptions of FIG. 6(a) will be defined 



as follows: 

1) An inter-processor synchronization instruction 
for the processor to output the task termination 
information to the synchronous processing cir- 

5 cuit 101 and declare the termination of a task is 
designated by reference "S". 

2) Processors PI , Pm and Pn form a group and 
execute related tasks while establishing syn- 
chronization in the group. 

70 3) Each of the processors PI, Pm and Pn, after 
having executed the instruction S, is uncondi- 
tionally kept waiting until the synchronization 
termination information (TEST output) from the 
synchronous processing circuit 101 becomes 

75 active (until all of the processors PI, Pm and Pn 
have terminated their tasks at a current level 
and respectively execute the instruction S.) 

4) Even if the synchronization termination in- 
formation is in the inactive state, each of the 

20 processors can limitatively execute as many 
instructions as possible, which instructions exist 
in an instruction queue and an instruction cache 
inside thereof, as long as external data is not 
used for such an execution. More specifically, 

25 for an external bus cycle generated for access 
to the synchronous processing circuit when the 
instruction S is to be executed, a synchronizing 
logic is configured such that the active Ready 
signal is prohibited from returning to the proces- 

30 sor until the synchronization termination informa- 
tion becomes active so as to forcibly interrupt 
the external bus cycle (the external bus cycle 
for access to the synchronous processing circuit 
is prohibited from terminating), and the internal 

35 processing of the processor doesn't stop, i.e., 
the processor can execute its internal process- 
ing as possible. 

5) An instruction which does not use external 
data (for example, an operation between regis- 

40 ters and so on) is designated by "P. On the 
other hand, an instruction which uses external 
data other than data on a sharing system CSYS 
is designated by "ID", and that using shared 
data on the sharing system by "ICD". 

45 FIG. 6(b) illustrates a case where a local 

synchronization method is employed to forward- 
ly progress subsequent task processings until 
the sharing system is first accessed by an in- 
struction ICD. The above-mentioned conditions 

so and assumptions 1), 2) and 5) defined for FIG. 
6(a) are also applied to FIG. 6(b), while the 
conditions 3) and 4) in FIG. 6(a) are respectively 
replaced by the following conditions 6) and 7) in 
FIG. 6(b): 

55 6) Each of the processors Pt, Pm and Pn, after 
having executed an instruction S and delivered 
the active task termination information to the 
synchronous processing circuit, forwardly pro- 
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gresses a task processing at the next level until 
a sharing system access instruction (ICD) is 
newly issued. 

7) At the time each of the processor PI, Pm 
and Pn, forwardly processing the task forwardly 
at the next level under the condition 6), is to 
execute the sharing system access instruction 
(ICD) for the first time, if the synchronization 
termination information has not become active, 
the active Ready signal 19 generated by the 
ICD for an external bus cycle is prohibited from 
returning to the processor until the synchroniza- 
tion termination information becomes active. In 
other words, the external bus cycle generated 
by the ICD is forcibly interrupted (the bus cycle 
is prohibited from terminating) until the synchro- 
nization termination information becomes active. 
Incidentally, the instruction I on an instruction 
queue or on an instruction cache can be for- 
wardly progressed if executable. The synchro- 
nous processing performed by an instruction 
ICD and the synchronization termination infor- 
mation is referred to as the "local synchronous 
processing", as described above. 
In FIG. 6, reference SYNCK indicates a time at 
which the active synchronization termination infor- 
mation returns from the synchronous processing 
circuit, that is, synchronization is established at a 
level k. In FIG. 6(a), empty times are produced in 
the processors PI and Pm in the latter half of a 
level k-1 and in the processors PI and Pn in the 
latter half of the level k. In these empty times, the 
processors remains inactive (execute inoperative 
processing). In FIG. 6(b), since each of the proces- 
sors can progress its processing until an instruction 
ICD appears, no empty time is produced in both of 
the levels k-1 and k except for a short empty time 
in the processor Pm in the latter half of the level k- 
1. Assuming that the start point is M and the end 
point is N, the processor PI reduces its processing 
time by ti, the processor Pm by tm, and the 
processor Pn by tn, comparing the case shown in 
FIG. 6(b) with that in FIG. 6(a). The processor 
which executes the critical path of the parallel 
processing is the processor Pn at the level k-1, Pm 
at the level k and Pi at the level k + 1 in FIG. 6(a), 
whereas it is the processor Pn at all of the levels k- 
1, k and k + 1 in FIG. 6(b). It will be appreciated 
from these drawings that the critical path itself has 
changed. Such a change in the critical path is 
caused by the fact that each of the processors 
forwardly processed tasks at two or more levels, 
which leads to dynamically changing the substan- 
tial task processing time. As the result, a whole 
processing time needed for the parallel processing 
shown in FIG. 6, from the processing start time M 
to the end time N, is reduced by tc, in comparison 
of FIG. 6(b) with FIG. 6(a). Such a reduction in time 



is equal to an improvement of the processing abil- 
ity by approximately 21%. ft will therefore be ap- 
preciated that the local synchronization method can 
largely improve the processing ability of the multi- 

5 processor system. 

Incidentally, in FIG. 6(a) and (b), points A, B 
and C indicate the positions at which the synchro- 
nization instructions S executed by the processors 
Pi, Pm and Pn appear at the lever k-1, respec- 

10 tively. Also, points D, E and F indicate the positions 
at which appear the instructions ICD of the proces- 
sors Pi, Pm and Pn each accompanying a sharing 
system access which are executed for the first time 
in a task executed at the level k. Similarly, points 

75 G, H and I are the positions of the instructions S at 
the level k, and points J, K and L the positions at 
which the instructions ICD appear for the first time 
in tasks executed at the level k + 1 . 

As described above, the present embodiment 

20 can remove fixed borders between tasks which are 
defined in for example FIG. 5 as levels for synchro- 
nizations and forwardly progress as many task pro- 
cessings as possible until a need arises to access 
the sharing system for the first time to commu- 

25 nicate shared data in a task processing, thereby 
making it possible to reduce an empty processing 
time (inactive time of the processors) caused by a 
waiting processing among the processors in a syn- 
chronous processing. This leads to dynamically 

30 changing a task processing time in accordance 
with synchronization conditions of the respective 
processors to reduce the critical path itself of a 
parallel processing, thereby producing similar ef- 
fects to those of a data driven system and enabling 

35 the execution of a more efficient parallel process- 
ing. 

For dividing a fixed job into tasks and paralelly 
processing these tasks in a general-purpose multi- 
processor system, the synchronous processing cir- 

40 cuit of the present embodiment groups arbitrary 
processors executing related tasks and employs a 
synchronous processing method for establishing 
synchronization among processors belonging to the 
same group or among groups, whereby a synchro- 

45 nizing mechanism for the processors can be imple- 
mented by hardware to such a region that nu- 
merous parallel processing flows could be pro- 
grammed by software using functions of the syn- 
chronizing mechanism, so that software overhead 

so required for the synchronous processing is mini- 
mized. 

Next, FIG. 8 shows an example of instruction 
sets for a synchronous processing system for pro- 
cessors to realize a reduction of inoperative pro- 
55 cessing time of processors in software during a 
parallel processing by means of a control flow. A 
basic softwared control flow may be formed by 
using the synchronous processing circuit shown in 
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FIG. 4, however, for a higher performance, control 
lines 4 composed of separate lines 4a, 4b and 4c 
each having a particular function as shown in FIG. 
7 is employed. The line 4a transmits a signal for 
triggering a flip-flop 7 for outputting task termina- 
tion information, and the line 4b a trigger signal for 
registering information showing a group of proces- 
sors to be synchronized in a synchronous register 
5. The line 4c will be described later. 

The contents of FIG. 8 will be next described. 
For operating the synchronous processing system 
for processors shown in FIG. 7, each of the proces- 
sors n (n = 0,1, ...) can designate a total of eight 
instructions SYNCO - SYNC7 for correspodning 
synchronous processing elements n (n = 0, 1, ...). 
Respective instructions are provided with mnemon- 
ics which express their functions. Basic functions of 
the respective instructions are as follows: 

GS .... Group Setting (registers group informa- 
tion in a synchronous register 5 to indicate proces- 
sors which constitute the group.) 

EO .... End Out (makes the task termination 
information active and outputting the active infor- 
mation onto a task processing termination signal 
line to indicate the termination of a task.) 

W .... Wait (keeps processors in a group in a 
waiting state until all the processors belonging to 
the same group have terminated respective tasks. 
This is a function for finally examining whether a 
synchronous processing has been terminated.) 

The above-mentioned basic functions may be 
combined to form the following complex instruc- 
tions which can be each executed as a single 
machine instructions: 

GSEOW .... sequentially processes the respec- 
tive functions in the order of Group Setting (GS), 
End Out (EO) and Wait (W), thus executing a 
sequence of a synchronous processing by a single 
machine instruction. 

GSEO sequentially processes the respec- 
tive functions in the order of Group Setting (GS) 
and End Out (EO). 

EOW sequentially processes the respec- 
tive functions in the order of End Out (EO) and 
Wait (W). A sequence of the synchronous process- 
ing is executed in the form of a single machine 
instruction for a group previously set by the GS 
function. 

Besides, there are the following complex 
instructions for providing higher speed and simpli- 
fied processing executed by the processor side: 

TSEOW .... sequentially processes the respec- 
tive instructions in the order of Total Setting (TS), 
End Out (EO) and Wait (W). 

TSEO sequentially processes the respec- 
tive instructions in the order of Total Setting (TS) 
and End Out (EO). 

TS in the above complex instructions, called 



"Total Setting", designates a basic function for 
instructing a synchronous processing for all the 
processors as a group. This is a function for setting 
the value of the synchronous register to a state in 

5 which all the processors are assumed to belong to 
a single group by making the signal line 4C shown 
in FIG. 7 active. 

The use and effect of the complex instructions 
will be next described, compared with a conven- 

10 tional control flow, with reference to FIGS. 9A and 
9B. 

FIG. 9A shows a parallel processing control by 
means of a conventional synchronous processing 
which is performed by using the synchronous pro- 

75 cessing system for processors shown in FIG. 7. In 
the drawing, processors m and n constitute a 
group. As has been previously described, the pro- 
cessors m and n declare to each other that they 
belong to the same group at the time when both of 

20 the processors respectively have terminated their 
tasks. Then, until both task processing termination 
signals outputted at that time from the processors 
m and n in the group become active, the processor 
m waits for the processor n, or vice versa. When 

25 both the task processing termination signals cor- 
responding to processors m and n have become 
active to finish the synchronous processing be- 
tween processors m and n, the processors m and n 
can progress the processing to the next tasks, 

30 whereby the parallel processing is advanced with- 
out contradiction. 

FIG. 9B shows an example of a control flow 
(which controls the parallel processing in a top- 
down manner by software synchronous instruc- 

35 tions) which separately employs an EO instruction 
(for outputting only task termination information) 
and a W instruction (for examining whether or not 
the task termination information signal 9 (TEST 
signal) corresponding to a processor have been 

40 ready and waiting until the task termination in- 
formation signal 9 becomes ready) to thereby ac- 
complish an effect similar to that produced by an 
auto-tuning function using a data-driven (data flow 
type) performed in accordance with the access 

45 condition for accessing to the shared common sys- 
tem CSYS, as has been described with the em- 
bodiment shown in FIG. 1. Previously, a compiler 
inserts an appropriate synchronizing instruction se- 
lected from SYNCO - SYNC7 shown in FIG. 8 at 

so points in a program where the parallel processing 
in the level is completed and the synchronous 
processing is to be performed. The synchronizing 
instructions SYNCO - SYNC7 are properly used 
under the following conditions: 

55 (1) At the time one processor has terminated a 
task, if there is no relation from a task executed 
by the other processor which will terminate the 
execution at the same level to a task which is to 
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be next executed by the one processor, an EO 
instruction for only outputting the active task 
termination information is inserted. More specifi- 
cally, in the examples shown FIG.S 9A and 9B, 
this condition is satisfied at the times of termi- 
nating tasks 3 and 4. Explaining the processing 
from the view point of the processor operation, if 
a processor, when progressing the processing to 
the next task after having terminated a task, 
does not require information from the other pro- 
cessor which executes a task at the same level, 
the EO instruction is executed to unconditionally 
progress the processing to the next task. 
(2) When a task to be next executed by one 
processor after the presently executed task has 
been terminated has a relation with a task ex- 
ecuted by the other processor which is to be 
terminated at the same level as the presently 
executed task, a processor which has executed 
the EO instruction at the preceding synchroniza- 
tion level to proceed to a task processing cur- 
rently under execution executes the W instruc- 
tion as a synchronization checking instruction 
corresponding to the EO instruction executed at 
the preceding level to confirm whether or not 
the synchronous processing at the preceding 
level has been terminated. Then, the synchro- 
nous processing at the present level (for exam- 
ple, GSEOW or EOW) is executed to progress 
the processing to the next task. More specifi- 
cally, in the examples shown in FIGS. 9A and 
9B, this condition is satisfied at the time when a 
task 5 has been terminated. On a program, the 
W and EOW instructions may be inserted in this 
order at the time of the termination of the task 5. 
The synchronization level mentioned here cor- 
responds to SYNC levels 1 - 3 shown in FIGS. 9A 
and 9B and refers to a time when the task process- 
ing has been terminated and the execution of the 
synchronous processing is required. Incidentally, 
the difference between the GSEOW instruction and 
the EOW instruction lies in that the former includes 
a function (GS) for setting us a group register 5 
with information of a group composed of proces- 
sors to be synchronized, while the does not include 
such a function. Therefore, when the EOW instruc- 
tion is designated, a processor group configuration 
set by the previous GS function is used as it is as 
a default value. 

Next, the sequence of the processing shown in 
FIG. 9B will be described. 

(a) It is assumed that tasks 0, 2, 4 and 6 are 
executed by the processor m in this order, while 
tasks 1, 3, 5 and 7 by the processor n in this 
order. In this example, it is also assumed that 
there are relations between the respective tasks 
indicated by arrows in the drawing. 

(b) The processing results of the taks 0 and 1 



are commonly used by the tasks 2 and 3. It is 
therefore necessary to establish synchronization 
between the processors m and n at SYNC level 
1. A sequence of the synchronous processing 
5 from the group setting to the synchronization 
establishment check is accomplished by a sin- 
gle instruction, that is, the GSEOW instruction 
executed by both of the processors m and n. 

(c) At SYNC level 2, the task 4 uses the pro- 
w cessing results of the tasks 2 and 3, while the 

task 5 only uses the processing result of the 
task 3. However, there is no change of group. 
Therefore, the processor m executes the EOW 
instruction to perform a sequence of the syn- 

75 chronous processing from the output of the task 
termination information to the synchronization 
establishment check. Meanwhile, the processor 
n executes the EO instruction to immediately 
proceed to the next processing without perform- 

20 ing the synchronization check (W function). 

(d) At SYNC level 3, the task 6 requires the 
processing result of only the task 4 while the 
task 7 requires the processing results of both of 
the tasks 4 and 5. Therefore, the processor m 

25 executes the EO instruction to immediately pro- 
ceed to the next processing without performing 
the synchronization check (W function). On the 
other hand, the processor n executes the W 
instruction corresponding to the EO instruction 

30 executed previously (at SYNC level 2) to per- 
form the synchronization check at SYNC level 2, 
and next executes the EOW instruction to 
progress the processing to the next task (the 
task 7) after executing a sequence of the syn- 

35 chronous processing at SYNC level 3 (in other 
words, confirming that the task 4 has been com- 
pleted). 

It can be seen that inoperative times ta and tb 
produced in FIG. 9A are almost eliminated in FIG. 
40 9B by the operations described above. 

The characteristics of the control flow method 
according to the present embodiment will be de- 
scribed as follows: 

(1) When a relation between tasks and a pro- 
45 cessing time of said each task have been pre- 
cisely known, an optimum tuning for eliminating 
inoperative time can be accomplished only by 
inserting an appropriate synchronization instruc- 
tion in a program according to rules at the time 
so of a previous paralleling schedule. An automatic 
tuning, if employed in this case, cannot strictly 
judge the relation between tasks, so that it pro- 
vides an optimum tuning inferior to the present 
embodiment. 

55 (2) Since no special hardware is required except 
for the synchronous processing system shown 
in FIG. 7, the control flow can be realized at a 
low cost. 



11 



21 



EP 0 475 282 A2 



22 



On the other hand, the control flow method of 
the embodiment is disadvantageous over the auto- 
tuning method shown in FIG. 1 in the following 
points: 

(1) If a task processing time is not precisely 
known, it is not ensured that the basic paral- 
leling schedule itself provides an optimum paral- 
leling efficiency. Particularly, a high efficiency 
cannot be expected for a processing in which a 
task processing time dynamically changes. 

(2) Since the synchronous processing function is 
separately used (for example, it is separated 
into the EO and W instructions), synchronous 
processing overhead is slightly increased. 

tt is possible to minimize inoperative process- 
ing times of the processors and provide a more 
effective optimum parallel processing by combining 
the control flow of the present embodiment with a 
data flow type auto-tuning in the form of hardware 
utilizing the aforementioned access condition for 
accessing to the share common system CSYS. 

According to the invention, the synchronous 
apparatus for processors is provided with a plural- 
ity of processors for sharing a plurality of tasks and 
parallelly processing the shared tasks, a data shar- 
ing circuit for sharing data communicated among 
the processors, a synchronous processing circuit 
for establishing synchronization among the plurality 
of processors, and a local synchronization circuit 
for controlling contending access requests from 
each of the plurality of processors for accessing 
the data sharing circuit, wherein when a task pro- 
cessing has been terminated with a synchronous 
processing under way, each of the processors can 
forwardly progress the next task processing as 
many as possible until shared data is needed in 
the next task, thereby producing an effect of reduc- 
ing an empty processing time. 

Also, for processing jobs in parallel, related 
processors are grouped, an the processors belong- 
ing to the same group or groups are synchronized 
with one another, whereby a synchronous process- 
ing mechanism can be implemented by hardware, 
producing an effect of minimizing software over- 
head required for a synchronous processing. 

Claims 

1. A synchronous apparatus for processors com- 
prising: 

a plurality of processors (1n) for sharing a 
plurality of tasks and parallelly processing the 
shared tasks; 

a data sharing circuit (102) for holding data 
which is shared by said plurality of processors; 

a synchronous processing circuit (101) for 
generating, when processors of said plurality of 
processors belonging to a predetermined 



group in which sycnhronization should be es- 
tablished have terminated all task processings, 
a status signal indicative of the termination of 
all the task processings in said group; and 

5 a local synchronization circuit (50n) coup- 

led to said synchronous processing circuit and 
said data sharing circuit for commanding pro- 
cessors in said group which have terminated 
their task processings before the generation of 

w said status signal to execute the next tasks 

until said data sharing circuit is first accessed. 

2. A synchronous apparatus according to claim 1 , 
wherein said local synchronization circuit (50n) 

75 includes for each of the processors in said 

group: 

means (200) for detecting an access re- 
quest signal issued from an associated proces- 
sor to said data sharing circuit; and 

20 logic means (208, 211) for operating a 

logical OR of an output of said access request 
detecting means and said status signal and 
generating a ready signal for extending the 
termination of a bus cycle to said associated 

25 processor when said status signal has not 

been generated and said access request signal 
has been generated. 

3. A synchronous apparatus according to claim 1 , 
30 wherein said synchronous processing circuit 

(101) includes for each of said processors: 

synchronous registers (UB0 - UBn; 5) each 
for storing bit information outputted from an 
associated processor for designating proces- 

35 sors in a group to which said associated pro- 

cessor belongs; 

means (UC0 - UCn, UA0 - UAn, St DO - 
SlDn; 6, 7, 8) for cancelling the designation in 
said bit information corresponding to a proces- 

40 sor in said group when said processor has 

terminated a related task processing; 

means (UDO; 6) coupled to said cancelling 
means for detecting, on the basis of the state 
of said bit information, that all of the proces- 

45 sors in said group have terminated task pro- 

cessings; 

means (UB0 - UBn, T10 - Tin; 7, TIO - 
Tin) coupled to receive a signal from said 
detecting means indicating that all of the pro- 
50 cessors in said group have terminated the task 

processings to supply a synchronication ter- 
mination signal to said associated processor; 
and 

means (UB0 - UBn, UA0 - UAn, UDO, 6, 7, 
55 8) coupled to receive the signal from said 

detecting means indicating that ail of the pro- 
cessors in said group have terminated task 
processings to restore said synchronous regis- 
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ter to an initial state. 

4. A synchronous apparatus according to claim 3, 
wherein said synchronous processing circuit 
(101) includes a single flip-flop means (7) for 5 
each of said processors, said flip-flop means 
having: 

a trigger clock input terminal responsive to 
a storing operation for storing said bit informa- 
tion to said synchronous register to be trig- 10 
gered; 

an input terminal (PR) for inputting the 
signal from said detecting means, said signal 
indicating that all of the processors in said 
group have terminated task processings; 15 

a first output terminal (Q) responsive to a 
trigger to said trigger terminal to generate an 
output for cancelling a designation in said bit 
information stored in said synchronous register 
corresponding to said associated processor as 20 
well as responsive to a signal inputted to said 
input terminal (PR) to restore said bit informa- 
tion in said synchronous register to the initial 
state; and 

a second output terminal (Q) responsive to 25 
the signal inputted to said input terminal (PR) 
to output said synchronization termination sig- 
nal to said associated processor. 

5. A synchronous method for a plurality of pro- 30 
cessors which share a plurality of tasks and 
parallelly process the shared tasks, comprising 

the steps of: 

outputting from each of said processors bit 
information for designating a processor in a 35 
group to which an associated processor be- 
longs, upon terminating a task processing un- 
der execution, and storing said bit information 
in a synchronous register (UBO - UBn; 5) pro- 
vided in each of said processors; 40 

cancelling the designation corresponding 
to said associated processor in said bit in- 
formation stored in all of said synchronous 
registers in the processors by each of said 
processors at the time each of said processors 45 
has terminated a task processing (UCO - UCn, 
UAO - UAn, SI DO - SlDn; 6, 7, 8); 

detecting for each of said processors that 
all of processors in a group to which said 
associated processor belongs have terminated 50 
task processings on the basis of the state of 
the bit information in said related synchronous 
register (UDO; 6); 

providing said associated processor with a 
synchronization termination signal when all of 55 
the processors in said group have terminated 
the task processings (UBO - UBn, TtO - Tin; 
7, TtO - Tin); 



detecting, in each of said processors, an 
access request signal generated from said as- 
sociated processor to a data sharing circuit 
(102) for holding data shared among said pro- 
cessors (200); and 

generating, in each of said processors, a 
ready signal for extending the termination of a 
bus cycle to said associated processor when 
ail of the processors in said group to which 
said associated processor belongs have not 
terminated all task processings and said ac- 
cess request signal has been generated (208, 
211). 

6. A synchronous method according to claim 5 
further comprising the step of restoring, in 
each of said processors, all of said sycnh- 
ronous registers in said group to an initial state 
when all of the processors in said group to 
which said associated processor belongs have 
terminated the task processings (UBO - UBn, 
UAO - UAn, UDO; 6, 7, 8). 

7. A synchronous processing system for synchro- 
nously processing a plurality of processors and 
controlling a parallel processing without con- 
tradiction to necessary processing sequence 
comprising: 

means for instructing an output of active 
task termination information corresponding to 
said each processor at the time said each 
processor has terminated a task thereof; 

means for resetting said active task ter- 
mination information corresponding to said 
each processor to an inactive state, when task 
termination information from processors which 
should be synchronized has become all active, 
using the information at this time; and 

means for recognizing the termination of a 
synchronous processing by examining said 
task termination information by the processors. 

8. A synchronous processing system for proces- 
sors according to claim 7 including an instruc- 
tion (EO instruction) for instructing an output of 
processor-active task termination information 
and an instruction (W instruction) for recogniz- 
ing the termination of a synchronous process- 
ing. 

9. A synchronous processing system for proces- 
sors according to claim 8, wherein: 

if, at the time one processor has termi- 
nated a task, there is no relation from a task 
which has been executed by another proces- 
sor and terminated at the same level as the 
task terminated by said one processor to a 
task which is to be next executed by said one 
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processor, the EO instruction for only output- 
ting the task termination information is insert- 
ed, and 

if said one processor, when proceeding to 
the next task after having terminated a task, 5 
does not require information from other pro- 
cessors which have executed tasks at the 
same level, said one processor executes the 
EO instruction to unconditionally progress the 
processing to the next task. w 

10. A synchronous processing system for proces- 
sors, wherein one processor which has ex- 
ecuted the EO instruction at the preceding 
synchronous level to proceed to a task pro- 75 
cessing presently under execution, if a task to 
be next executed at the time of the termination 
of the task has a relation with a task which is 
to be executed by another processor and ter- 
minated at the same level, executes the W 20 
instruction as a synchronization examining in- 
struction corresponding to the EO instruction 
which has been executed at the preceding 
level, and thereafter a synchronous processing 
is performed at the present synchronous level 25 
to progress the processing to the next task. 
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